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ABSTRACT ■ . 

-*-* A comparison between standard kindergarten programs 
and' AEL Vs preschool program was conducted to gain some insight into 
the desirability of using the laboratory-developed, procedures rather 
than standard classroom procedures for affecting learning in 3-, 4-,. 
and, especially, 5-year-old children., Initial differences in 
intelligence test scores were observed. The group which- received all 
components of AEL*s Preschool Education Program achieved higher 
scores than a control group on all three, parts of the test designed 
to measure achievement of cognitive objectives. The kindergarten 
group also achieved higher scores on one part of the test of 
cognitive objectives. The girls in all treatment groups outscored the 
boys on most tests, AEL 1 s program was shown to reach the objectives 
measured by two sub tests where other programs including the standard 
kindergarten program did not. The achievement of these objectives 
implies that AEL's Preschool Education Program is an acceptable, if 
not preferred, alternative to other early childhood education 
programs, (Author/CK) 
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A Comparison of AEL's Preschool Education Program 
with Standard Kindergarten Programs 



* .• Introduction 

The Appalachia Preschool Education Program developed by the Appalachia 
Educational Laboratory has been field-tested for the past three years, begin- 
ning in the fall of 1968, The program was designed for children 3, 4, and 
5 years of age living in rural areas ..of -Appalachia. Elements of the program 
include a daily 30-minute television program seen by the children in their 
homes; a weekly visitxby a paraprofessional home visitor who discusses the 
program with parents., confers with children, and .delivers curriculum mate- 
ri alST-and-at-tendanee by the children— in a mobile classroom once each week 
for one and one-half hours.. A more complete. 'description of the program is 
given in the Evaluation Summary Report (1971) which is available from AEL. 



The original evaluation design for the three-year field test did not 
include a comparison with istandard kindergarten programs, primarily because, 
there seems to be little consensus on the objectives for kindergarten pro- 



AEL's preschool program were based on diagnosed 
1968) of Appalachian children' and. the program 

objectives. — The- Appalachia Preschool Test, an 

instrument designed to measure the degree to which those, objectives had 
been reached, 'was constructed and administered to various treatment groups. 



grams. The objectives for 
needs (Hooper and Marshall 
-was-des,4.-gn&d-t-o-me et-t-ho s e 



The field test site was in .eight j counties surrounding Beckley, W.Va. ‘ _ 
The. superintendents and other school-personnel- from the eight counties in- 
the field test area met witji Laboratory personnel' in Beckley, W.Va,, in 
September, 1970. These educators /suggested*. that AEL's preschool program 
be compared with kindergarten programs then in operation in urban centers.. . 
They were curious whether gains in cognitive and social ’skills among children 
in kindergarten programs and the AEL program would be similar. Since the AEL 



program cost was only about 
siderable savings, would res 



one half that of a kindergarten program, con- 
ult if it couli be shown to achieve comparable 




results. - The AEL .program offered the further advantage of reaching children 
living in remote areas not normally -'served by kindergartens. As a' result of 
the meeting with local School officials, an agreement was reached with Me rc or 
County Public Schools for the Laboratory personnel to' administer pre and 
post-tests to .children attending kindergartens in Pritrceton and Bluefield 
W.Va. • - <=.. 



Purpose of the 



an son 



The purpose of comparing achievement ga insb e.tween standard kindergarten 
programs and AEL’ s'. preschool program was to gain some insight into the desira- 
bility of using the Laboratory developed procedures rather than standard class- 
room procedures for effecting learning in 3-, 4-, -and especially 5-year-old 
children. The Laboratory development earn was of the opinion that the needs 
of Appalachian children could be more effectively met through the multimedia 
'approach. The more global purpose of this and ail evaluation efforts was 
to provide information to those persons making educational decisions in a 
manner so, that the decisions can be based on expected outcomes, 

" “ Description of the Comparison 

The comparison between standard kindergartens and the AEL preschool pro- 
gram was completed as a part of the total evaluation of AEL’s Preschool 
Education Program. The different treatment group samples and analyses are 
described in the summary report and other evaluation technical reports. The 
following description of samples and analyses performed is, especially perti- 
nent to the kindergarten comparison. 

"1 - 

• \ • . ' ■ 

Des cription of the Samples 

i.. ' f . 

fh e children, who deceived the AEL preschool pro'gram were in three treat- 
ment groups. The first group \ of 31 5-year-old children had access to a 
daily television program, were visited by a paraprofessional home visitor, 
attended a mobile classroom, and were therefore labeled TV-HV-MC, The 
/' second treatment group of. 49 5-year-old children received only the tele- 
vision lesson and home visitor (TV-H V) and the third group of 31 children 
only Had access to a. televisionj'program (TV only) , These children were 
located in south central West Virginia^ and were --initially randomly selected 
from. a geographical grid to participate in- the different treatment groups. 

In addition to the 5-year-old ch Lid ron, • there- were about "et|tial numbers of. 
children in the different treatment groups who were 3 and 4 years of age at 
the beginning of the. program year,, but only those who were 5 years of age_ 
were used in the statistical comparisons . with the kindergarten children. 

- In addition to the three treatment groups , a control or no-treatment 
group was located in Monongalia County in northern West Virginia. The region 
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was similar to the field test area in topology, and the group was selected 
to be, of a similar socioeconomic level. The region was out Of the receiving 
range of the AEL instructional television program. There were 34 5-year-old 
children in the control group, and the testing was completed by the Human 
Resources Research Institute of West Virginia University, 

Only about one half of the children' (randomly selected) in these four 
groups received pretest scores, so smaller sized groups will be observed on 
pretests than on post-tests. 

The kindergarten groups were located at Knob Elementary School in 
Princeton and Preston Elementary School in Bluefieid, W.Va. The children 
attended kindergp.rt.en for a half day, and both groups were in the viewing 
area of the television./program. Pre and post data were collected on 31 chil- 
dren in Princeton and 35 in Bluefieid for a total of 66 kindergarten chil- 
dren, and both groups were combined as the kindergarten sample. The morning 
session in each kindergarten was from 8:30 to 11:30, the evening session from 
12:00 to 3:00, and both included a lunch period. According to a program 
description by Mercer County Schools (1970), first consideration in enroll- 
ment was: given to children from economically disadvantaged families. The 
pretesting was conducted in early October;, 1970, and the post-testing was 
completed in June, 1971. ... 



Inst I’ument.at ion • 

I _ .. - , 

The Appalachia Preschool Test (APT) was used to compare cognitive achieve- 
ment among the various groups. The test was designed to measure the specific .. 
objectives of the program. 

The test was revised each year as formative evaluation results indicated 
the need for program changes , and the/ different parts represent additional 
learning objectives. Part 1 of the APT consists of an interview with"” the • 
child in order to build a readiness. ’’for testing, and the results are not 
included in this report. Part 2 is a 6.1 - item test, developed by the AEL 
staff early in 1969. It consists of a variety of tajSks , with the "following 
number, of items comprising the total:' vocabulary - 15 ‘items ; relational 
terms - 14 items; letter and number recognition - 6 items; mathematical sets - 
4 items ; geometric shapes - 4 items; and beginning and ending sounds 8 
j.tems. The remaining 10 items were related to body parts, calendar dates , 
and time related terms. Parts 3 and 4 of the APT were not used in the pre- 
sent testing. . * ' 

Part 5 of the APT includes 18 .items which measure logical reasonings 
sensory discrimination and labeling, and letter recognitions It was intended 
to supplement Part 2, Part 6 also is comprised of 61 items and was primarily 
in multiple choice format, as was Part 2* All three subtests are made up of 
'items designed to measure program objectives as the program evolved during 
the three-year field test. r 7 ' ... : " - 



' i .. % , 

The Peabody Picture Vocabulary Test GPPVT) was intended as a measure by 
I which the equivalence of two groups could be determined and as a means of 
adjusting scores on the attainment of program objectives.. The PPVT consists 
of a series of 150 plates, each consisting of four separate illustrations. 

One of the four illustrations on each plate corresponds to a word given by 
the examiner, and the child is asked to identify the correct plate. The 
test ^ continues until a series of six incorrect answers in eight responses ' 
is given, A total raw score of correct responses is recorded, and a Mental 

•*- s derived from the total score . In addition, raw' score and chrono- 
logical age are used to .derive a deviation IQ score, utilizing a mean of 100 
and standard deviation of 15. A more complete description of the nature and 
use of the PPVT is included in Technical Report No. 13. ^ 

Socioeconomic data were collected on a form designed by the Laboratory. 
The questions pertained to community size, education of parents, occupation, 
and family income . The data were coded so that Hoi lingshead ' s Two Factor. 
Index of Social Skills (1957) could be recorded for each head-of-household , 
and it was. ..used to compare the background of the different. -treatment groups . 
The^ scores vary from "5" for an individual in the lowest categories of 
income and education to a "1" for an individual in the category with , highest 
income' and most education. 



Description of Analyses 



The PPVT raw scores and age in months were used as covariates in a two- 
way analysis of covariance of the data from the test of cognitive objectives. 
The two levels were two sexes and five treatment groups,, (TV-HV-MG, TV-HV, 

TV only, no treatment, and kindergarten) . All children' were approximately 
5 years old. Age and PPVT raw score, were used as covariates rather than 
PPVT IQ alone because the latter is a derived score rather than- a direct 
measure. The purpose in using covariance analyses was to adjust the post- 
test means according to initial differences in age and PPVT raw score among 
the different groups. In effect,,. the post-test achievement scores were «■ 
adjusted fnsofar as the achievement w as related to differences in~ age and 
intelligence test scores among the. treatment groups. The pretest scores 
are presented for the.. APT subtests, but no analysis is reported for them. 

•Analysis of variance and analysis of covariWce were computed using a 
program whi-ch adjusts, for uiiequal cellysize . - A statistic called ETA squared 
(n 3 was used in the analysis of variance tables to indicate, the proportion 
of variance attributed to each level (Hays, 1963, pp. 546-54.8) . For example, 
8.2 percent (.082 x 100) of the variance in PPVT" rawv scores. Was attributed 
to differences among treatment groups as indicated in Table 23.2. The means 
for treatment groups were adjusted by covariance and are shown graphically.. 
Dunnett's tests (Myers , 1966 , p. 337) were, used to identify significant 
differences between individual treatment group means when- the analyses of ■ 
variance and covariance were significant. The adjustment in means through 
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covariance usually was about .1 to .3 raw 'score, points and always less than 
one point. The .adjustment also always raised the scores of the control and 
TV only groups with respect to the other treatment groups. 



\ 
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Analysis of Peabody Picture Vocabulary Test, 
Age, and Socioeconomic Differences 



The two variables used as covariates in, an analysis of differences in' 
cognitive [achievement reported in a later section were, PPVT raw scores and 
age in months.- Therefore, the analyses reported in. the following section 
are designed to indicate differences in measured intelligence and age among 
the different treatment groups. In addition, the derived PPVT IQ scores 
and socioeconomic data are presented so that differences in intelligence 
as measured by the PPVT and socioeconomic background may be observed. 



PPVT Raw Score .. 

The raw scores displayed in Table 23,1 indicate that the 16 males who 
received the mobile classroom, home visitor, and television program (TV-HV-MC) 
received the highest mean score (61,4) on the post-test. The lowest score 
of 52.7 was obtained by the girls in the same treatment group. The gain 
scores are exhibited in a similar manner; the seven females in the TV-only 
group achieved the greatest gain'f‘"'rfie three treatment groups had higher 
mean gain scores than either the- control, or kindergarten group. Note that 
-.he gain ‘scores means cannot be subtracted directly from the post-test 
means to yield pretest scores because different numbers of individuals were 

involved,- *, ... 

u-- ■>-* ~ ‘ 

In order to determine whether there was an. effect due to repeated 
testing using .£ he same instrument,, some children were excluded from the 
pretest. Subsequent analysis showed no retest effects . The fact that only 
about, one half of the children were given the PPVT as a pretest was also 
the reason that the PPVT post-test .scores were used as a covariate.' 

' Table 23.1 
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PPVT Raw .End Gain Score Means and, Sample 
t Sizes by Treatment and Sex 



Measure 


Sex 


TV-HV-MC 


TV-HV 


TV Only . 


. Control 


K 1 ga^ten 


■ Total 


Pbs t-t.es t Scores 




- 












Mean (x) 


Male 


61.4 


59.2 


53.8 


55.5 


58.0 


57.9 


Number (N) 




16 

U. J* * -• 


27 


*1 12 


18 ' - 


42 


115 ' 


Mean (x) 


Female 


52.7 


56.0 


54.5 


54.3 


' 'SS3 


55.1 


Number (N) 




15 


22 


19 


16 


24 


96 , 







y. 







- ■ 




Table 23,1 (Continued) 



Measure 


Sex 


TV-IlV-MC 


TV-HV 


Only 


Control 


K'garten 


Total 


Mean (x) 


Total 


57.2 


1 03 

: 


, 54.3 


54.9 


57.6 


56.7 


Number (N) 




31 . 


49 


31 


34 


66 


211 


‘^ain Scores 
















Mean (x) 


Male 


7.4 


10.5 


9.6 


9 . 2 


5.3 , 


7 . O 


Number (M) 




8 


11 


5 


9 


4 2 


75 


Mean (x ) 


Female 


7. 2 


8.9 


14.3 


4.3 


6 . 4 


8 . 0 


Number ( N) 




8 


15 


7 - 


6 ’ 


19 


55 


Mean (x) 


Total 


7.3 


9.6 


12 .3 


5.5 


. 5 . ,6 


7 , 4 


Number (N) 




16 


26 


12 


15 


61 


130 



As indicated in Table 23.2, the PPVT raw score means from tests admin- 
istered in. June, 1971, as a post-test were significantly different (r> < QOS) 

r ~° ; n< ’i lt T* 1110 hl 8 hest irtean- for a treatment group was 57.8 for the 
IV-MV, and the lowest was' 54.3 for the TV only.' However, a Dunnett’s test 

It thesis fevel ° f Th dif f e rt nCeS betWeen " ,CanS fail ? d to Positive results 

at the .05 level. The differences related to sex were not significant 

Sion'h t 57 *' 9 f ° r th j mal6S VS ‘ ‘ 55 ‘ 1 for the ^males) , nor was the inter- ' 

T , ! f, 5ex and treatment group significant. According to the n 2 in 

lahle 23 . * , 8.2 percent of the variance in PPVT raw scores was explained by 
differences attributable, to treatment effects. . Y 



Table 23.2 



Analysis of Variance of PPVT Post-test Raw Scores 



Source 






d. f . 



Trt . 

Sex 

Group, x Sex 
Error 



.082 

.001 

.022 



4 

1 

4 

202 



Mean 'Squ art; 



14105". 02 
' 791.77 
3855.45 
3007,51 



4.69 

.26 

1,28 



JV 



.005 
NS 
NS 



^Treatment groups are TV-HV-MC, TV-HV, TV only , control , and kinder- 
gar ten . . : r ! 

Eta square (n?) is. the proportion of variance accounted for by each ■ 
source _and is determined by dividing each ( sums of squares by the total 
; u 5 of s q uare ^- A convenient reference is: Hays, William L, Statis- 
tics^, Holt, Rinehart and Winston, 1963, p. 546-548 ’ — 



f6j 



O 

ERIC 



10 



T ab 1 e 23*3 

Analysis of Variance of PPVT Raw Score Gains 



Source 


i r 


d.f. 


Mean Square 


F 


P 


Trt. Groups 


,068 


4 


272.68 , 


2,32 


NS 


Sex 


.000 


1 


0. 89 


0.76 


NS. 


Group x Sex 


.034 


4 


136.83 


1.16 


NS 


Error 




121 


117.44 







The difference in mean gain scores among treatment groups and by sexes 
was not significant as indicated in Table 23*3. The fact that one group 
did not gain more in FPVT raw score than another was considered an indica- : h 
tion that all groups were learning at about equal rates, and that the PPVT 
post-test was therefore an effective and appropriate instrument by which 
to adjust for initial differences among treatment groups. 

PPVT IQ • • 

The highest mean PPVT IQ achieved by any, group was 112.2 for the 
TV-HV-MG males (Table 23.4)* The lowest IQ was 92.9 for the females of the 
same .treatment group. One group, the seven TV only girls, had a mean PPVT . 
IQ gain of 14*8 points and the average gain for all groups was 6.2 points. 
The differences in PPVT IQ gain scores were hot significant (Table 25,5Qu -> 

' None of the programs changed the IQ as measured by the PPVT; none of them 
included that change in their objectives. 

As with the, PPVT raw scores, the differences in PPVT IQ scores were 
found to be significant when compared according to treatment groups, How = 
ever, the Uunnett f s post analysis \of variance test again failed to discrimi- 
nate between means, \ 
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PPVT Post 


-■test Total Sample Mean IQ Scores 
IQ Gain Scores on Partial Sample 


and Mean 




Measure 


Sex 


TV-HV-MC 


• TV— HV 


^ TV Only n 


Control 


K 1 garten ; 


Post Test x 


Male 


112.2 


107.1 


101.2 


100.5 


104.4 


X 


Female 


92,9 


102.4 


98.9 

j- 


‘ 98.3 


102.9 


X 


Total ■ 


102 , 9 


■'105.0 


99.8 


99.5 


103. 8 


Gain Scores 

X 


Male 


1.9 


10.0 


5.8 


7,2 


5.1 


X 


Female 


-0.4 


7.3 


14.8 


5,3 


7. 3 


X 


Total 


0.G 


8.4 


t 11.0 


6,4 


'5*8 



*Sample sizes are the same as reported in Table 23.1. 

Table 23.5 . 

Analysis o£ Variance of PPVT Post-test IQ Scores 



Source 


n 2 


d. f . 


Mean Square 


P 


P 


Trt. Group 


. .083 


4 


46351.98 


4.67 


■n. 005 


Sex ° 


.002 


1 


4794.05 


.48 




Group x Sex . 


.021 


4 


11739% 86 


1.18 




Error 




201 


9932.36 







— ™ 


Analysiso 

•o 


Table 
f Variance 


23 .6 , 

ofP-P-VT- -IQ^ Gain^S cores 

a 


. 


Source 


n 2 


d.f. 


Mean Square 


F 


P 


Trt. Group 


.051 


■ • 4 


492.10 


1.68 


NS 


Sex 


.000 


1 


15.30 


0.52 


NS 


Group x Sex 


.015 


4 


146.06 


0.50 


NS 


Error 






291.89 







/ 



Age . 4 

" ' - * '** • 77 

'Hie children in the treatment groups used for this technical report were 
supposed to he at least 5 years of age as o£ September 50* and some difference 
in age was expected to. exist among, the groups. The age in months of the child 
at the time of post-testing (June* 39713 was entered as a variable and used 
as a covariate in later analyses. ' ■ ' ' ~ — 

According to Table 23,7 the oldest group was the TV-HV-MC and kinder- 
garten children with a mean age in months of 73,2* and the youngest was the 
control group with a mean age of 71 .1 months. These differences were not 
significant at the .05 level'of confidence as shown in Table 23.8* 

- .. ‘ I 

Table 23*7 

Mean Age in Months at Time of Post- 
testing by Treatment Group ' 

- r\ ■= - ■ • a -7 ' - . 





TV-HV-MC 




TV Only 


Control 


K'gairtan 


,r: Total 


Mean (x) 


73.2 


71.9 * 


72,1 


71.1 


73,2 


7214 


S . D. 


5.0 


4,7 




4.4 


3.7 


4.6 


N 


31 


49 


31 


34 


66 


211 



‘Table 23.0 

‘#4 ‘ I 

Analysis of Variance of Age in Months 






Source 


d, f . 




Mean Square 


F 


P 


Between Groups 
within Groups 
Total 

& . ' ■ ~ ,s : 

- ■' 6 . . . . . A 


4 

„ 206 ^ 
210 


^038,2 
: . 4420.9 

£0559.1 


, •• 34.55 

21.46 


1 „ 60 


N.S. .. 


Socioe conomi c Levels 








Q 

s 


— 



: ^As indicated in Table 23v9^ the group with the highest economic and 
educational level was .the control group with a Hoi Lings he ad Two Factor 
score of. 3.47, and it was followed by the kindergarten group with a score 
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0 



„f 3.(,.J . The least economically and educationally advantaged was the TV 
only group with a score of 4,27.. However* none of these differences ' wore 



found to ho statistically significant (Tahle .23. 10) . 






Table 23.9 



Mean Hollingshead T.wo Factor Index 
Score by Treatment Groups « 






" 3 


TV-HV-MC 


TV-HV 


TV Only Control 


' ,v 

. K.’. gar ten 


Total- £ 

- — a 


Score x* 


3 * 87 


3.7© 


4.27 3.47 


3.64 


3. 


£ 

71.’. 


S. D, 


.76 


.67 


. 90 ■ .86 


.81 


- 


91/ 


N 


23 


9 


11 30 


v 53 


126 




% of total 


74.1 


18. 3 


35.4 88.2 


80.3 


59. 


7 


N 






- • . 








* Lower scores indicate 


higher 


educational and economic attainment. 
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Table 23.10 
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Analysis 


of Variance of Spcioecongmic 

^ ... . • ° , t 


: Data' 

; >V 
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A j 


r 




Source 




d. f. 


SYS- . Mean Square 


• ‘ F- Ip. 


+ . 




Between 


.. Groups 


4 


6.133 1.53 


2.32 NS 


■ 




Within 


Groups 


121 


80.001 ,0.66 




- 




Total 




125 

Q . 


86.134 *. * ’*? 
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Analysis of_ Appalachi a, Pres chool Test Results 

’ ’ = ‘ ' • -■■■ * V: - . r-* : 



An important criterion by which success of early childhood programs + 
are judged is the 1 eve IHolf v aicliie vemerit" ~ of. ;^^iTiyV>'^Je<St'iveis* This section 
reports 'the analys is of scores from thej'Appa lachia PresqhooL, Test , the AEL? 
developed instrument designed to measure achievement 0 of those cognitive 
objectives identified as important, for Appalachia children th^pugh the 
preliminary needs study. ’ ’ ' y a 
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Appalachia Preschool Test, Part 2 ■ ^ , ' 

’ r " ' "•* 

Part 2 of the APT, as described in Technical Report No, 14, is a 
multiple choice subtest of 61 items and was designed •’to measure cognitive 
objectives taught during the first program year,. Table 23.11 presents the 
pretest and post-test raw score? by sex fox the five groups! The pretest * ’ 
:s co tes, r a rc based on fewer Individuals than the post-t&st scores because not 
all individuals were pretested, , 

Table 23.11 ■' 





Post-= 


test and Pretest Score 
Part 2 by Treatment 


Means for 
and Sex* 


APT, 


' : 


Measure 


Sex 


TV-HV-MC 


TV-lIV 


TV only 


Control 


Kindergarten 


Post -test 


x Male 


48.7 


- - ” 

. 43.7 


" - & ■ 

36.7 


34.3 


.. 41. 5 




x Female 


44.5 


45.3 


40.4 


39.9 


42 '. 8 • 




x Total 


46,6 


44.4 


39.0 


36.8 


42.0 


Pretest 


x Male 


33,2 


36.2 


2-2.9 


27.6 ' 


It* 

36.0 ** 




x Female 


32.3 


32.0 


28.1* 


33.3 


31.6 


- 


x Total 


. 32,7 


' 33,6 


25.8 1 


30.2 


34r3 



r 1 * 

* 



. *S amp Ilf sizes are the 
data for one control 



same as reported in Table 23.1 except that post-test 
female was not Available, <f 



i 



As for interpretation of the table, the TV-HV-MC males had a mean post- 
, test score on the APT! Part 2, of 48. 7 compared to a mean, for the girls of 
44,5, The mean for. the total TV-HV-MC group was 46,6, The total group mean, \ 
. of 46,6 represented 1 correct responses to 76 percent of the 6T items. in Sub- ./,* 
test 2, , • i. * ' ' . r : — i . 

■ •• '■ ■ ■' • V -• ■ ' , 

When the post-test raw scores were adjusted according to differences . f 
in age in month's and , PPVT raw scores, the pattern of means, shown in Table 
23, 12 emerged . The differences among, jneans for the treatment groups were 
significant at the ,005 level as abdicated in. Table *23, 13 , and the treat- 
ment group means are shown graphically in Figure' °23,1.^ 



^ ....... ... ■ . .... > , ......... . • , 

‘ Dunnett Is tests were completed to determine "which treatment group means 
were significantly greater than other means , and any difference of 4,4 between 
! meartsT 'was significant at the . 05 'leve’lT " Therefore , the TV-HV-MC group ach i e v ecT 
significantly higher scores than the TV only, control, and kindergarten groups. 
The, TV-HV grbup also achieved significantly higher! scores than the TV , only 
group. Other differences were not significant according to the Dunnett 1 s 
test. ® The test indicated that girls in all groups combined a^chieved signifi- , 
cantiy higher scores than boys when differences in age and PPVT raw scores 
were used to adjust means. . * - - 



Table 23.12 



Adjusted Post-test Means for APT , Part 2 by 
Treatment Group and Sex* 



Sex 


TV-HV-MC 


TV-HV 


TV only 


Control 


K'garten 


Total 


M 


4 5.7 


42.1 


38.3 


35.1 


40. 5 


40. 5 


F 


46.7 


45.8 


40.0 


•41.4 


42.5 


. 43.2 


Total 


/ 46.2 


43.8 


39 .2 


40.0 


41. 2 


, 41.8 


*See 


Table 23.1 for 


s ample 


sizes , 









Table 23.13 



Analysis o£ Covariance of Post-test Raw Scores by 
Treatment and Sex for APT, Part 2 



Source 


n * 


d.f. 


Mean Square 


F 


P 


Group 


.094 


4 


359.48 


5.41 


<.oos 


Sex 


.026 


1 


396.50 


5.9 7 - 


<,05 


Group x Sex 


.010 


4 


- -39.43 


0 . 59 

y l 




Govs . 




2 


1 163374, 00 ~~ 


2459 ! 




Cov. 1 




1 


194.27 


2.92 




Cov. 2 *' 




1 


5026.88 


75 . 7 




Error * ^ 


.870 


199 


66.42 


, 


* 



*Eta" (n 2 ) is the particular source of variance (e.g., group) divided 
by the sum of the group, sex, group x sex, and error sums of squares. 



The program implication from the analysis of scores on APT , Part 2^ is 
that groups which received all components of AEL's program achieved higher 
scores than a control group, a group which only observed the television pro- 
gram, _ and _a kindergarten group. The seorej-, were from an instrument designed 
to measure the achievement of cognitive objectives considered important to 
5-year-old children* The kindergarten group and two other treatment groups- - 

TV-HV and TV only- “failed to score significantly higher than_the control 
group. Therefore, the important Jimp 1 i cation from the APT, Part 2, is that 
5-year-old children in AEL’s program reached more cogni ti^e^ ob"j ectives th an 
children in a kindergarten program. 5 3T r ^ 






[ 12 ) 



4 5.0 



40,0 



35, 




TV^HV-MC 

46.2 



39.2 . 40.0 

Figure 23.1 



41.2 



Adjusted Fost^test R aw Score Means for 
AFT f Part 2 by Treatment Groups 



Appalachia Pres chool Test , Part 5 



Part 5 of the APT was an "18- item subtest designed as a £ .^pi^ment to 
measure additional cognitive objectives.. The raw score ifteans are included 
as Table 23.14, and the pretest means are shown in the same table. All 
analyses, including analysis of variance of gain scores and of post-test 
raw scores, showed high levels of significance, but the most indicative 
analysis was that based on an analysis of covariance of post-test raw 
scores. The covariates again were age in months and PPVT raw scores. 
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Post-test and 


Gain Score 


Means for APT, 








Part 5 -by "Treatment Group““andSex* 




i, 


7 ‘ Measure 


Sex 


IV-HV-.MC 


TV-HV 


TV only 


Control 


Ki ndergarten 


Post-' test 


x Male , 


15.8 


14,8 


10.8 


10,4 


12.7 


i 


x .Female 


14.3 


18.3 


15.0 


11.9 


13,2 




x Total 


15,1 


16,4 


13,4 


11,1 *'■' 


. 12.9 


Pretest 


x Male 


10.1 


I 

11,1 


8,1 . 


9,2 


10.5 




x Female 


9.9 


11.0 


9:5 


12.1 


10.3 




x Total 


10.0 


11.0 


8.9 


10.5 

• x . 


10.4 



^Sample sizes are the same as reported in Table 23.1. - 



The adjusted means are depicted in Table 23.15, and the analysis of 
covariance results is given in Table 23.16. The difference in treatment 
group means is shown in Figure 23.2. The group with the highest adjusted 
mean score was the TV-HV children with 16.1 of the 18 items, or 89.5 percent, 
answered correctly. The Dunnett's tests indicated that, a difference in means 
of ”3.0 was significant at the .OSlerel, Therefore, the TV-HV-MC, TV-HV, 
and iV only groups scored significantly higher than the control group, and 
the TV-HV group scored higher than the kindergarten group. Other differences 
were not significant . The order of means from highest -to lowest was TV-HV, 
TV.-HV-MC, TV only, kindergarten , and control . five girlsun all groups again 
achieved higher scores than the boys. 

1 * . • £i- 

r - : 

The program implication again was that a group receiving- tin; Appalachia 
Preschool Education Program achieved higher scores than the control and 
kindergarten groups. On this test of logical reasoning, sensory discrimina- 
tion and labeling, and letter recognition, th~e kindergarten . I group did not , - 
achieve significantly Higher scores than the control group. Children who 
received AEL's program reached more cognitive objectives than 'kindergarten 
children or children who received no treatment.: 

* . '• .. .. . ■ ; 

’ Table 23.15 . » 

Adjusted Post-test Means for „ 



Q ^ 




5 by Treatment; Group 


and Sex*. 






, Sex 


TV-HV-iMC 


TV-HV 


TV only 


Control 


K'garten 


Total 


s , 

M . . 


14.7 


14.3 


11.4 


10.7 * 


12.4 


12.7 


' F 


15.2 ■; 


18.5 


15.6 


12.7 


13.1; - 


15. 1 


Total 


14.9 


16.1 


13.9 ... 


Ilk 6 


12. 6 


13.8 


*S ample 


siaes are 


given in 


Table 23.1. 




o 





Table 23,16 



Analysis of Covariance of ■ Post-test Raw Scores by 
Treatment Group and Sex for APT, Part 5 



Source 


n 2 * 


d.f. 


Mean Square 


P 


p 


Group 


. .079 


4 ; 


s 

- 141,52 


4 . 54 


.005 


Sex 


.034 


1 


247.52 


7,95 


<.005 


Group x Sex 


.012 


4 


32.90, 


1.06 


. v 


Covs . 




2 


18043., 6 


579 


• - 


Cov. 1 




1 


2.30 


0.-74 




Cov. 2 




1 


710.14 


22.7 




f=rror " 5 


.875 


199 


31.15“ 







*Eta 2 (n 2 ) is the, particular source of variance (e.g,, group) divided 
by the sum of the group, sex, group x sex, and error sums of squares 



Means 

18,0 



16 * 0 



14.0 



12 . 0 ' | 



roTO- ' f~ ~ 




TV-HV-MC TV-HV TV only Control. ’Kindergarten 
14.9 16.1 13.9 , 11.6 12.6 



■ Figure 23.2 

Adjusted Post^test Raw Score Means for 
ART , part ,5 by Treatment Groups, 



Appalachia Preschool Test, Part 6 , 

. ...... . 

Part 6 of the APT is similar to Part 2 discussed, previously and also 
contains 61 items. It was designed to measure obj ectives taught during the 
third program year which were not adequately sampled by other parts of the 
APT. 

The post-test raw score means are given in Table 23.17, and since this 
test was not, used as a pretest, no pretest scores are presented. The analysis 
of variance of the post-test raw scores yielded highly significant results. 

(p < .005), but the analysis of covariance table is reported since initial 
differences in age and intelligence were controlled, * < 



Table 23.. 17 



Post-test Mean Scores for APT, Part 
6 by Treatment Group and Sex* 



Measure 


Sex ' 


TV-HV-MC 


TV-HV 


TV only 


Control- - 


Kindergarten 


Post- test 


x Male 


V, 

50.9 


*47.1 


35.6 

t 


33.8 


46.0 


t ■ ■ ? 


x Female 


47.5 


47.6 


44.1 


40.8 


47.7 


/, 


x 6 Total 


49.2 


47.3 


40 . 8 


. 37. 1 . 


46.6 



. .. '^Sample sizes are the same as reported in Table 23.1. 



The adjusted. means are given in Table 23.18, and other covariance data 
are given in Table 23. 19 . Figure 23.3 is a graph showing the differences 
in treatment group means. • „ ' • ■ 



Table : 23.18 ’ . .. 1 . \ 

§ f ; 

Adjusted Post-test Means ^or'APT, Part 
6 by Treatment Group and Sex* ■ ? 



s ! ' " * ' 


r 




... ■ - — 






- - •' 


j Sex 


' TV-HV-MC. 


TV^HV 


TV only. 


- Control 


' K*garten 


Total 


i 

1 ■ 


■'‘'I-' ■ 








- • • 


* j 

— 4'3vl- 


• fW 


'4870 




“37 .2 


34.6 


45.0 


' r u 

: | F 


50.0 v 


48.1 


45.6 


- 43.5 


* 47.4 


47.0 


| Total 


49.0 


46.7 


42*3 


38.6 


45.7 

C «T - . P 


:,.^44.9 



*See Table 23,1 .for semple sizes. 




( 16 ) 




t 

\ O 



i" f 








<5 










’Table 23,19 



Analysis of Covariance of Post-test Raw Scores by 
Treatment Group and Sex for APT, Part 6 



Source 


n 2 


d.f. 


Mean Square 


F 


P 


Group 


.134 


4 


556.44 


8.58 


<.005 


Sex 


.060 


1 


1062.66 


10.39 


<.005 


Group x Sex 


.025 


4 


107.66 


1.66 




Covs . • 




2 


184935,00 


2853 




Cov. 1 




1 


436,41 


6.73 




Cov .- 2 




1 


4818.90 


\74 .3 




Error 


.781 


199 


V 64.83 







Means i 
50.0 4 




TV-HV-MC TV-HV TV only ' » Contro 

" 49 .,0 r 46.7 42.3^ , 38.6 * 




5 

.j • .< 



45.7 



’ T 



Figure 23. 3 



„ • (.! / 



Adjusted Post-test Raw Score Means for ATT , 
Part 6 by Treatment Groups 



- The order of treatment groups from highest mean to lowest mean Was 
TV-HV-MC, TV-HV, kindergarten, TV only* and control* -.The" Dunnett's analyses 
indicated that the TV-HV-MC and TV-HV groups achieved significantly higher 
mean scores than either the TV only or control groups and the kindergarten 
group achieved significantly higher scores than the control group. The 
e i-rls again ac hieved higher scores than the boy s. :A„. „• . - __ 



x\... 



The program implication from the APT, Part 6, analyses was that -5 -year- 
old children in AEL* s. Preschool Education Program Again achieved signifi-- 
cant ly -higher scores than a control group which did not- ha ve' access to the 
television program, home visitors , or a mobile classroom and higher than a 
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group which had access to TV only. The kindergarten group also achieved a 
higher score than the control group. Although not statistically significant, 
the mean score for the. TV-HV-MC group was again higher than the mean score 
for the kindergarten group, 



Summary 



The Appalachia Preschool Education Program developed by the Appalachia 
Educational Laboratory has been compared with a standard kindergarten program 
on the basis of achievement of objectives judged to be appropriate for 5-year- 
old children in Appalachia, The comparison was considered especially impor- 
tant by certain Appalachian school personnel since the AEL program was demon- 
strated to cost approximately half as much per year as a full day kinder- 
garten program* 

Initial differences in intelligence test scores were observed, so the 
PPVT raw scores and age. in months were used as covariates in order to adjust 
scores on the test of achievement of cognitive objectives. ! The differences « 
in economic and educational levels of the parents favored the control and 
kindergarten groups, but the differences were not statistically significant* 

The group which , received all components of AEL's. Preschool Education 
Program achieved higher scores than a control group on all three parts of 
the “test designed to measure achievement of cognitive objectives^ The kinder.^ 
g arte ii group also a ch i e vc d higher, scores- on’ one part of thb test of cognitive 
objectives thought to measure most accurately the third year T s programming 
effort. Children who received AEL's program achieved significantly higher 
scores than the kindergarten children on two of the three tests of cognitive 
objectives, - 

... . =' . _ ■; 

K T.he girls in all treatment groups puLscored the boys on most tests. 

Since the effect was observed in the control group as well as .other treat- 
ment groups , . the higher scares by girls could have been due to more rapid 
development patterns for girls or perhaps to the effect of greater expecta- 
tions for girls. , ■ ■ ' * * - Jr 



The inst ruction of children by ^television , using a paraprofassional 
home visitor to counsel with parents and children, and providing opportunities 
for social interaction of children through experience on a mobile classroom 
did hav e an effect on the achievement of cognitive objectives by a randomly 
selected sample .of 5-ygar-oid children in inif al--Appalachia; "" i 



Program Imp ligations 



. Program selection of AEL l s Preschools Education Program as an alternative, 
to other early childhood education, programs depends partly on acceptance of 
the objectives which AEL's program .was designed to reach. The list -of\ objec- 
tives-' was too long to be included in this report and may be obtained from 



AEL * s Diffusion Department. The objectives derived through a survey of ' 
Appalachian children (Hooper and Marshall, 1968) were used as a pool from 
which to obtain objectives for AEL's preschool program. The Appalachia 
Preschool Test was designed to measure cognitive achievement of children in 
the program. . , . 

- * AEL's program was shown to reach the objectives measured by two sub- 
tests where other programs including the standard kindergarten program did 
not. Both the children in the kindergarten program and AEL's preschool 
program did reach more of the objectives than did a control group. 

The achievement of these objectives implies that AEL's Preschool Educa- 
tion Program is an acceptable, if not preferred, alternative to other early 
childhood education programs, .. . — - 
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